Super-resolution and reconstruction of far-field ghost imaging via sparsity constraints 



Wenlin Gongj and Shensheng Han 
Key Laboratory for Quantum Optics and Center for Cold Atom Physics of CAS, 
Shanghai Institute of Optics and Fine Mechanics, 
Chinese Academy of Sciences, Shanghai 201800, China 
(Dated: September 9, 2011) 

For ghost imaging, the speckle's transverse size on the object plane limits the system's imaging 
resolution and enhancing the resolution beyond this limit is generally called super-resolution. By 
combining the sparsity constraints of imaging target with ghost imaging method, we demonstrated 
experimentally that super-resolution imaging can be nonlocally achieved in the far field applying a 
new sparse reconstruction method called compressive sensing. Some factors influencing the quality 
of super-resolution ghost imaging via sparsity constraints are also discussed. 
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Super-resolution is always an important topic in imag- 
ing science [l], Q. In practical applications, the imaging 
resolution is limited by the noise and the bandwidth of 
the system. Exploiting the evanescent components con- 
taining fine detail of the electromagnetic field distribution 
at the object's immediate proximity, super-resolution 
can be achieved, but this method is only applied in 
the near-field range 

[aH|. While beyond the near-field 
range (namely in Fresnel and Fraunhofer regions) @, 
the diffraction effect of the transmitting/receiving system 
limits the imaging resolution, such as scanning imaging, 
fluorescence imaging, telescope and so on @, H, 0| ■ Us- 
ing additional a priori information of optical system, the 
imaging resolution beyond Rayleigh diffraction limit can 
be obtained. However, the improvement degree is lim- 
ited inpractice because of the influence of detection noise 
[3. Ifl [8p-fTo| . Ghost imaging (GI), which is based on the 
quantum or classical correlation of fluctuating light fields, 
has demonstrated theoretically and experimentally that 
one can nonlocally image an object |13l - l25| . Although 
differential ghost imaging [2l|, [22[ and the spatial averag- 
ing technique [23|,[24[ can improve the visibility of pseudo- 
thermal GI and speed up the convergence, the imaging 
resolution is limited by the speckle's transverse size on 
the object plane |16l - tl8| . When signals satisfied a certain 
sparsity constraints, Donoho had demonstrated mathe- 
matically that super-resolution restoration was possible 
[2fjj and lots of sparse reconstruction methods had been 
used to reconstruct the superresolved images 

EMI Sit 

However, the above sparse reconstruction methods were 
limited by their special conditions. Recently, a new 
sparse reconstruction method called compressive sensing 
(CS), which also relies on sparsity constraints of images, 
has proved that images can be stably extracted by ran- 
dom measurement when the sensing matrix satisfies the 
restricted isometry property (RIP), and this method has 
been widely applied in lots of fields to improve the signal- 
to-noise ratio of images because it is robust to noise and 



SOD) 



D, 



'Electronic address: gongwl@siom.ac.cn 



(a) 



BS 



I 

Obj 



A 



Obj 



(b) 



< 












T 1 




FIG. 1: (a). Standard schematic of lensless far-field GI with 
pseudo-thermal light; (b). the physical explanation of far-field 
GI, the thermal source S shown in the scheme (a) acts as a 
phase conjugated mirror and a spatial low-pass filter because 
of its finite transverse size. 



universal, such as data compression, magnetic resonance 
imaging, even ghost imaging [27l - l30j . For GI, the fluctu- 
ating light field obeying Gaussian statistical distribution 
essentially satisfies RIP and the measurement is also ran- 
dom. Therefore, super-resolution GI is possible applying 
CS method because all images are sparse in a proper rep- 
resentation basis [29[ . 

For compressive ghost imaging demonstrated in Ref. 
27| . the speckle's transverse size is small enough to re- 
solve the object and the test detector is positioned at the 
near field of the object, thus the test detector should be a 
bucket detector, which can collect the global information 
transmitted through the object. Fig. 1(a) presents the 
experimental schematic for lensless far-field ghost imag- 
ing. Different from the case mentioned in Ref. [27|, the 
speckle's transverse size is too large to resolve the object 
and the test detector is fixed in the far field of the ob- 
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ject, thus a single pointlike detector is enough to record 
the global information from the object. In the exper- 
iment, the pseudo-thermal source S, which is obtained 
by passing a focused laser beam (with the wavelength 
A=650nm and the source's transverse size D) through 
a slowly rotating ground glass disk [l6|, is divided by 
a beam splitter (BS) into a test and a reference paths. 
In the test path, the light goes through a double-slit 
(slit width a=100^m, slit height /i=500/xm and center- 
to-center separation d=200^m) and then to a detector 

D t fixed in the far field of the object (namely Z\ > ^f-)- 
In the reference path, the light propagates directly to 
a camera D r . Both the object and the camera D r are 
located in the far field of the source (namely z > ^r~). 

The intensity distribution on the detection plane at 
time s can be expressed as [|| 

I s (x,y) = J dx 1 dy 1 dx 2 dy 2 E s (x 1 ,y 1 )E*(x 2 ,y2) 

x h*(x,y;x 2 ,y2)h{x,y;xi,yi). (1) 

where E s (xi,yi) denotes the light field on the source 
plane at time s, h(x, y; Xi,yi) and h*(x, y\ X2,y 2 ) are the 
impulse function of optical system and its phase conju- 
gate, respectively. 

By Ref . [3, 0, [H| > the correlation function for far- 
field GI shown in Fig. 1(a) can be represented as 

G (2,2) (x r ,y r ;x t ,?/t) oc | / dxdy'T(x,y') 
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where T(x, y) is the object's transmission function and 
sinc(x) = sip ( 7rz ) . From Eq. (2), by the intensity corre- 
lation measurements, the best resolution of far-field GI 
with thermal light is determined by the speckle's trans- 
verse size on the object plane (Ax s w which is the 
same as GI in the near field or Fresnel region [It], Gil . 

For far- field GI scheme shown in Fig. 1(a), a single 
pointlikc detector far from the object is enough to record 
the complete information of the object and its image in 
real-space can be reconstructed by measuring the inten- 
sity correlation function between the two detecto rs fla| . 
According to Klyshko's "advance optics" picture [32|], as 
shown in Fig. 1(b), the object can be considered as be- 
ing illuminated by a light source emitting the light from 
the test detector D t . After inverse propagating in free 
space, the Fourier-transform (FT) diffraction pattern of 
the object will appear in the far field of it (namely the 
source plane S) . Because the thermal source S acts as a 
phase conjugated mirror [T|| and a spatial low-pass fil- 
ter when the source's transverse size is finite, only the 
low space frequency part of the diffraction pattern will 



be reflected into the reference path. After propagating 
along the reference path to the far field of the source S, 
the reflected diffraction pattern will be inverse Fourier- 
transformed and a low resolution real-space image will 
finally be recorded by the camera D r . However, for the 
case shown in Fig. 1(b), Ref. (2(| has proved theoret- 
ically that super-resolution imaging can be obtained by 
exploiting the images' sparsity constraints, and CS also 
utilizes the sparsity constraints of the images in the re- 
covery process while the image extraction process of GI 
satisfies RIP of CS. Thus, combining GI with CS, super- 
resolved images can be reconstructed by ghost imaging 
via sparsity constraints (GISC) described next in detail. 

To GISC, we formulate it in the CS framework. For 
the GI system shown in Fig. 1(a), each of the speckle 
intensity distributions on the detection plane D r at time 
s is described by I s (x,y) (n x m pixels) and is reshaped 
as a row vector (1 X N, N = n X m). After K mea- 
surements, the random sensing matrix A (K x N) is re- 
constructed and at the same time, the intensities (B s ) 
recorded by the test detector D t are arranged as a col- 
umn vector Y (K x 1). If we denote the unknown object 
image as a A-dimensional column vector X (N x 1) and 
X can be represented as X = '5 - a such that a is sparse 
in the representation basis then the image can be re- 
constructed by solving the following convex optimization 
program [29ll3f3|: 
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X = * • a; which minimizes : - || Y - AX^ + r IH^ .(3) 



V|| 2 denotes the 



where r is a nonnegative parameter. 
Euclidean norm of V, and ||V||j = J2i i s the h norm 
of V. Therefore, for the image with sparse cartesian 
representation, the reconstruction process can be clearly 
written as follows based on Eq. (3): 
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I s (x,y) oc J dxidyidx 2 dy 2 E s (xi, yi)E*(x 2 , y 2 ) 



x exp{ — —[(xi - x 2 )x + (yi - y 2 )y] }■ (5) 

AZ 



B s oc J dx\dy\dx 2 dy 2 dx dy' dx" dy"T{x' 7 y')T*(x" ,y") 

x E s (xi,yi) exp{^(x' 2 + y' 2 - x" 2 - y" 2 )} 
Az 

x E ;{x 2l y 2 )eM^ 12 + y' 2 x" 2 y" 2 )} 

r^JTT, H it I ' \T 

x exp{— — (x x 2 + y y 2 - x xi - y yi)\ 
Az 

x sincf— —(x 1 — x")] sinc[— —(y' — y")]. (6) 

Azi Azi 



3 



_ 2 



3 1.5 



/1 280^m\ 



-200 200 
x t (x1 3|im) ( 2 

(a) 



(3 





(b) 



FIG. 2: Experimental reconstruction of a double-slit in 
different receiving areas with z=1200mm, zi=500mm and 
D=0.6mm (the speckle's transverse size on the object plane 
Ax s = 1280mm) . (a) . The cross-section curve of the speckle on 
the object plane obtained by measuring the second-order cor- 
relation function of light field on the reference detection plane 
(the curve's full- width at half-max is the resolution limitation 
of GI); (b). the object; (c). the object's diffraction patterns 
received by the test detector D t ; (d). GI method (averaged 
3000 measurements); (e) and (f) are GISC when the pixel- 
resolution of the camera D r is 13/j,m and 65^im, respectively 
(with 3000 and 500 measurements for (e)-(f), respectively). 
The receiving areas of the detector Dt shown in (1-3) are 
1.6mmx 1.6mm, 3.2mmx3.2mm, and 6.4mmx6.4mm. 



and |Tgisc| is the object's transmission function recov- 
ered by GISC method, L\ is the effective receiving aper- 
ture of the test detector D t . 

Figs. 2-3 present experimental results of a double-slit 
recovered by GI and GISC methods in different receiv- 
ing areas L\ x L\ and different distances zi, using the 
schematic shown in Fig. 1(a). For GISC method, we have 
utilized the gradient projection for sparse reconstruction 
algorithm [30, l3lj] . As shown in Fig. 2(c-d), the ob- 
ject's image can not be reconstructed by GI because the 
transverse size of the speckle on the object plane Ax s is 
much larger than center-to-center separation of the ob- 
ject, which is consistent with the result expressed by Eq. 
(2) and accords with the physical explanation described 
in Fig. 1(b). However, the images with the resolution 
beyond ^Ax s (Fig. 2(e,f)) and Fig. 3(a-d)) can be ob- 
tained by GISC. As the receiving areas of the detector 
D t are increased or the distance between the object and 
the detector D t is decreased, the quality of GISC will be 
improved (Fig. 2(e,f) and Fig. 3(a-d)), which can be 
explained by Eqs. (4-6) because the Euclidean term in 
Eq. (4) will approach zero such that Eq. (4) becomes 
the linear £i-norm problem as the increase of L\ or the 
decrease of z 1 29]. Moreover, as shown in Fig. 2(e,f), 
the resolution of the images reconstructed by GISC also 
depends on the pixel- resolution of the camera D r . 

To verify the super-resolution ability of GISC for more 
general images and the effect of the object's sparse rep- 
resentation on the quality of GISC, as shown in Fig. 
4(c) and (e), a transmission aperture ("zhong"ring) with 
the resolution beyond ^Ax s is reconstructed by GISC in 
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FIG. 3: Experimental results of the same double-slit in dif- 
ferent distances zi, and the other conditions are the same 
as Fig. 2 (using 1000 measurements), (a)-(d) are GISC when 
the pixel-resolution of the camera D r is 26/im and zi=500mm, 
200mm, 100mm and 10mm, respectively. The receiving area 
of the detector Dt is 6.4mmx6.4mm. 
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FIG. 4: Recovered results of an aperture ("zhong"ring) in 
different representation basis, with the same conditions of Fig. 
3 and zi = 10mm (using 2000 measurements), (a). The ob- 
ject; (b). GI reconstruction; (c). GISC reconstruction when 
the object is represented in cartesian basis; (d). the object's 
discrete cosine transform (DCT) coefficients; and (e). GISC 
reconstruction when the object is represented in DCT basis. 



cartesian and DCT representation basis, which suggests 
that the images with much better quality can be obtained 
by choosing a proper representation basis. Therefore, 
for the first time, we demonstrate experimentally that 
far-field superresolved imaging can be realized by uti- 
lizing the images' sparsity constraints in ghost imaging 
schemes. 

In single-photon imagin g sy stem, each of the photons 
only interferes with itself [33|, it is impossible to obtain 
the real-space image of a double-slit and its diffraction 
pattern at the same time because a photon cannot pass 
both of the slits to generate the double-slit's diffraction 
pattern while at the same time pass one of them to give 
out the double-slit's image in real-space. For GI, based 
on the property of spatial correlation between two light 
fields, it is also impossible to obtain both the image in 
real-space of the double-slit and its diffraction pattern at 
the same time in fixed GI schemes [l8|, [24], [25| . However, 
by taking the image's sparsity as a priori information, in 
far- field GISC system shown in Fig. 1(a), when the trans- 
verse size of the speckle on the object plane is much larger 
than center-to-center separation of the double-slit and 
the test detection plane is located in the far field of the 
double-slit, the double-slit's diffraction pattern and its 
real-space image, as shown in Fig. 2(c) and Fig. 2(e,f), 
can be obtained at the same time. Moreover, the recon- 
struction results of GISC don't only depend on how we 
measure the object as in a standard quantum measure- 
ment frames, but also depend on how sparse the object 
is in the representation basis (Fig. 3(d) and Fig. 4(c,e)). 
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Actually, for any GI system, we can find a suitable repre- 
sentation basis in which the object is sufficiently sparse, 
therefore, as shown in Fig. 3(d) and Fig. 4(c,e), super- 
resolution imaging can be achieved and GISC will be a 
universal super-resolution imaging method. Understand- 
ing what happens at quantum level in GISC seems to be 
an interesting challenge deserving more investigation. 

In conclusion, we have achieved super-resolution far- 
field GI by combining GI method with the sparsity con- 
straints of images. Both the approaches to realize the 
linear i^-norm problem and an optimal representation 



basis can dramatically enhance the image's reconstruc- 
tion quality. We have also shown that Fourier-transform 
diffraction pattern of the object and its image in real- 
space can be obtained at the same time. This brand 
new far-field super-resolution imaging method will be 
very useful to microscopy in biology, material, medical 
sciences, and in the filed of remote sensing, etc. 
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